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15 BACKGROUND OF THE INVENTION 

In computer graphics providing realistic human 
facial animation is a difficult problem. The human face 
is one of the most studied and scrutinized parts of the 
body. In addition, we as humans have the ability to read 

2 0 an expression and to identify individuals and expressions 

of emotions based on facial communicative signals, and to 
know when an expression is false from the slightest 
deviations. 

The shape of a computer generated face can be 
25 approximated by a set of geometric primitives such as 

polygons or curvilinear elements such as polynomials, 
splines, or NURBS (Non-Uniform Rational B-Splines) . These 
geometric primitives can be described in terms their 
position in a predetermined set of spatial coordinates 




EXPRESS MAIL NO. 



PA reiTV14V^ VIS 



using the two or three-dimensional coordinates of their 
vertices or end points. In addition, other data such as 
derivatives or normals of these surfaces or functions may 
also be used. 

5 These vertices are typically collected and combined 

into a matrix A in which the row vectors of the matrix A 
represent each image of the face, and the column vectors 
represent the various locations in two or three 
dimensions of the vertices used to define a face or 

10 object. In general if each of the vertices are defined 

in three dimensions, then for k vertices of a face or 
object, there will be 3*k column vectors. 

In the instance in which the face is moving, e.g., 
translating or rotating in space, or deforming, e.g., the 

15 relative displacement of the vertices changes relative to 

a body centered coordinate axis, then the vertices in the 
matrix are a function of time, t, or sample, k. 

Each row of vectors comprising the matrix A could be 
an emotion or facial expression displayed by an actor for 

20 a model face. All of the row vectors in a particular 

matrix A therefore taken together could represent a range 
of emotions and facial expressions for that model face. 
A subset of these various row vectors could be selected, 
weighted appropriately, and combined together to form a 

25 composite face having complex facial expressions or 

dynamics that could be processed and displayed by a 
computer system. 

However obtaining a complete set of expressions and 
facial dynamics for a particular face is often not 
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possible. The person whose face is desired may not be 
capable of generating the necessary facial expressions, 
or may not be available to generate the necessary facial 
expressions. The process of collecting the data is also 
5 time consuming. In addition, the process of collecting 

data can require specialized equipment such as a 3D 
digital motion-capture system. Such a system can include 
a video camera or single two-dimensional (2D) image that 
has been converted to a 2D or 3D computer graphics model. 

10 Therefore, it would be advantageous if dynamic 

animation data for a model face could be morphed or 
deformed to represent a static geometry or an image taken 
photograph so as to avoid the costs of collecting and 
analyzing facial data for the static object or 

15 photograph. 



BRIEF SUMMARY OF THE INVENTION 
A method and apparatus are disclosed for providing 
displayable expressions and animations for a target head 

20 by a non-linear morphing function that is derived using a 

standard head model and the target model. In general, to 
reduce the number and complexity of the computations 
involved, the vectors representing expressions are only a 
subset of the head vertices that move dynamically with 

25 facial expressions. A non-linear morphing function is 

determined that will morph a geometric model of a 
standard head to a geometric model of a target head. 
This morphing function is used to transform the 
orthogonal basis of the standard head model into anew 




basis of the target head model. Animation vectors of the 
standard model can then be combined with the new 
orthogonal basis of the target head model to create a 
sequence of animation poses. 
5 In one embodiment, the non-linear transformation is 

determined by placing the standard head model within a 
finite element mesh and deforming the finite element 
mesh, thus deforming the standard head model. The target 
head may contain marker locations that correspond to 

10 individual vertices on the standard head. Using a least 

squares optimization technique, the standard head model 
is deformed until the difference between the vertices of 
the standard head model and the marker locations have 
minimized the least square optimization function S. 

15 In another embodiment, the parameters of a non- 

linear function are adjusted until the difference between 
the vertices of the standard head model and the marker 
locations have minimized the least square optimization 
function S. The non-linear function may be a polynomial 

20 function, or a rational polynomial function, and in 

particular a Chebychev rational polynomial function. 

In another embodiment, the non-linear morphing 
function is determined by a linear combination of a 
plurality of standard head models. From this plurality 

25 of standard head models a new sub-set is created by an 

SVD analysis as described below, to create new static 
heads. In this instance, the emotions from a "parent" 
standard head are morphed to all the sub-set of static 
heads thus created. The target face is then described by 




a linear combination of the original standard head model 
and the plurality of morphed standard head models. The 
weights associated with the various standard head models 
are then used with the orthogonal basis matrices 
5 associated with the various standard head models to form 

an orthogonal basis matrix for the target head. 
Animation vectors of the original standard head model may 
then be used to linearly combine the orthogonal basis 
matrix of the target head to create target head animation 

10 vectors. 

In another embodiment, the non-linear morphing 
function is determined by a linear combination of a 
plurality of standard head models, wherein a first 
standard head model is morphed to provide a plurality of 

15 other standard models using the basis of the first 

standard model. However, the desired expression is to be 
taken from a second standard head model unrelated to the 
first standard head model, i.e., the second standard head 
model was not morphed from the first. In this case, 

20 after the proper linear combination of the first standard 

head model and the plurality of standard head models 
morphed therefrom, a morphing process is used to morph 
the second standard head into the target head, using any 
of the morphing techniques outlined above. The morphed 

25 orthogonal basis of the second standard head model is 

combined with an un-morphed expression vector of the 
second standard head model and the orthogonal basis of 
the target head to provide an animation vector for the 
target head. 




In another embodiment, when the pose of the standard 
head does not correspond to the pose of the target head, 
i.e., the target head includes an emotive expression, the 
standard head is combined with one or more expressions 
5 corresponding thereto, prior to a morphing function being 

determined. In this embodiment, the non-linear morphing 
function will be an optimization beginning from an 
emotive face, i.e., an offset face, and not a neutral 
face. The various weights that are used to form the 
10 offset face are also used in the optimization. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
The invention will be more fully understood by 
reference to the following Detailed Description of the 
15 Invention in conjunction with the drawings of which: 

Fig. 1 is a block diagram depicting a method for 
executing the non-linear morphing of faces and their 
dynamics described herein; and 

Fig. 2 is a block diagram of a video streaming 
20 system in accordance with the method described in Fig. 1. 

DETAILED DESCRIPTION OF THE INVENTION 
Fig. 1 depicts a method in accordance with the 
present invention for morphing a standard head model into 
25 a target head model using non-linear functions. The non- 

linear function is used to port standard expression poses 
corresponding to the standard head model to target 
expression poses. This allows for the simulation of a 
believable set of expressions for the target face. 




In particular, a geometric model of a target head 
containing three-dimensional (3D) data is obtained, as 
depicted in step 102. The target head may be obtained 
from a user or a customer seeking to create a series of 
5 animated images of the target head. The 3D data are 

typically the 3D coordinates of the surfaces of the face 
and head. The 3D data may be acquired using optical or 
mechanical techniques, inferred from one digital picture 
or estimated from two or more digital pictures acquired 

10 from a digital still or video camera or a single 

digitized two-dimensional (2D) photograph that has been 
converted to a 2D or 3D computer graphics model. A 
previously stored file of image or video data may also be 
used to generate the necessary 3D image data. This 

15 representation is typically referred to as a static model 

since there is no motion capture involved and therefore 
does not include dynamic sequences. 

The standard head model dynamics can be acquired in 
a variety of ways. In one embodiment, actors 

20 representing a range of ages, gender, ethnicity, and 

other features are recorded using a 3D motion capture 
system or a laser scanning instrument. The actors 
provide both a neutral face, i.e., a neutral facial 
expression showing no emotion or other dynamic features, 

25 and a series of emotional expressions and dynamic 

features. The emotional expression may include a smile, 
a wink, or a frown, and the dynamic features may include 
various facial expressions used when talking. In 
addition, combinations of the standard head models, or 




morphing of the standard head models may be used to 
create additional standard head models . 

In another alternative embodiment, a physiologically- 
based mathematical model of a face could be constructed 
5 so as to compute various facial expressions or 

deformations based upon input stimuli to the various 
physiological structures such as muscles, nerves, and 
joints. The model could be used to compute various 
facial expressions directly and as such could be used to 

10 generate facial expressions or object images. 

The models could be static, i.e. when the shape of 
the object (or location of vertices) are not dependent on 
previous history (previously assumed shapes) or dynamic 
when the shape depends on previously assumed shapes in 

15 time or how an external variable has been evolving in 

time. Models can also be linear or non-linear and time 
invariant or time-varying. These mathematical models can 
also be expressed in many ways, such as a state-variable 
model, a finite-element model or non-parametric 

20 representation. Models are typically predicting changes 

in the location of vertices or reducing their degrees of 
freedom. One example could be the stimulation of a muscle 
group leading to a deformation of a face (smile, wink, 
etc.). In the case of a non-linear state-space variable 

25 one could represent the deformation of the face in 

response to a nerve stimulation Sk=S (tk) , t* = {0, T, 2T, 
... nT} : 

A i =G{S l _ 1 ,S i _ 2t ...S 0 ) Eq. 1 




The static 3D coordinates for a set of vertices is 
obtained and extracted from the static model as is the 
orientation of the head, i.e., rotation and translation 
5 of the head with respect to a predetermined set of 

coordinate axes, as depicted in step 104. The standard 
head model is placed within a finite element cube that 
includes a plurality of vertices, such that the finite 
element cube includes a plurality of smaller sub-cubes. 

10 Each of the smaller sub-cubes therefore contains a 

portion of the standard face model. Other shapes of the 
finite element mesh and sub-structures may be used as 
well. For example other polygonal or geometric shapes 
used in finite element analysis could be used. The shape 

15 of the finite element mesh and the sub-structures can be 

changed depending on the type of deformations needed. 

Predetermined key points, or markers, are located on 
the target head model, as depicted in step 10 6 and are 
associated with the corresponding markers located on the 

20 standard head model, as depicted in step 108. In some 

instances there may not be a one-to-one correspondence 
between the markers located on the target face and the 
vertices located on the standard face. For example, the 
cheeks are typically a smooth surface and it is difficult 

2 5 to locate a marker point on the target head model and the 

corresponding vertex on the standard head model. In such 
instances the comparison is made by defining how close a 
marker is to a feature such as a surface defined by a 
small neighborhood of points, and by defining a marker on 




the standard face by projection on a subspace (surface or 
curve) defined by the neighboring points. In particular, 
a line is projected from the camera position to the 2D 
picture plane. The intersection of the projected line 
5 with the surface or curve is the equivalent position of 

the marker position defined on the target face. In some 
instances it may be necessary to further constrain the 
location of the intersection. For example certain points 
on the body, such as the tip of the chin and the tip of 

10 the nose, need to be aligned in one or more axes. As 

such the position of one of these points may be 
constrained in relation to the other. These markers can 
include, among other points, the tip of the nose, the tip 
of the chin, the ears, the eyes, the eye contours, the 

15 nose contours, the mouth contours, and the chin contours. 

In another embodiment, the target head model may be 
created from a combination of a plurality of standard 
head models selected to approximately match the target 
head model. In this embodiment there will be a one to 

20 one matching between the vertices of the created standard 

head model and the target head model. 

The parameters of a deformation function are 
determined, as depicted in step 110. The deformation 
function and the corresponding parameters are selected to 

25 deform the surface contours and features of the standard 

head model to match the surface contours and features of 
the target head model while minimizing predetermined 
error criterion. In one embodiment, the deformation 
function is selected to reposition the vertices, or 
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control points, of the various smaller sub-cubes thereby 
deforming the portions of the standard head model 
contained therein. The repositioning of the control 
points in a particular sub-cube is designed so that the 
5 surface and features of the particular portion of the 

standard head model contained in the particular sub-cube 
conforms to the surface and features of the corresponding 
portion of the target face, within a predetermined error 
criteria. Thus, by properly shifting the control points 

10 of the various sub-cubes within the finite element cube, 

the standard face is morphed into the target face. 

The deformation function, i.e., the new transformed 
coordinates of the control points, are also used to 
interpolate the vertices of the standard head model 

15 located between each of the key points or markers in 

order to conform to the target head model. The 
interpolated values will be located near the surface 
defined by the key points in a manner so as to minimize a 
predetermined error function. 

20 In the simplest embodiment, when vertices in the 

standard head and target head have a direct 
correspondence, a least square optimization process is 
used to determine the parameters of a suitable 
deformation function, wherein the following objective 

25 function, S, is minimized: 

S = ±lx--X^")J + { / --Y^")J4--z{^f] Eq. 2 
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where ^i n is the material x coordinate in the host mesh of 
node n of the standard face, ^ 2 n is the material y 
coordinate in the host mesh of node n of the standard 
face, and ^ 3 n is the material z coordinate in the host 
mesh of node n of the standard face. In addition X(^i n ) 
is a parametric equation for the X vertices, Y(^ 2 n ) is a 
parametric equation for the Y vertices, and Z (£ 3 n ) is a 
parametric equation for the Z vertices and are of the 
form: 

X&hZ^k")**'-' Eq. 3A 

7 fc B )=E Xp 2 , 'k"K-; Eq. 3B 

^fc")=Z V 3'fc')* Z i Eq. 3C 

where X ± , Yj., and Z±, are the shifted x, y, and z 
coordinates of the control points of the particular sub- 
cube, and Y 2 (€), and *F 3 (£) , represent an 
interpolation function such as a B-Spline, Hermite 
polynomial, NURBS, or another predetermined function used 
to interpolate the surface within the sub-cube. In 
another embodiment, an expansion of trigonometric or 
exponential functions could be used. Accordingly, X (£) , 
Y(^), and Z (£) represent the calculated spatial position 
of the points of the deformed surface of the standard 
head model by interpolating the host mesh. 

In the more general case where markers on the target 
head are obtained from 2D digital photographs, or when 
there is no direct correspondence between vertices on the 
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host mesh and the target mesh, the objective function is 
more complex, and can include constraints plus additional 
weighting or confidence parameters. In the case of 
markers obtained from a 2D photograph, the objective 
5 function, S, could also include an estimation of one or 

more additional parameters. These additional parameters 
may include the camera parameters, such as the distance 
to the subject and the focal length of the camera. In 
addition, these additional parameters may include the 
10 subject head orientation parameters (roll, pitch, and 

yaw) . The distance of the projected points in the 
photographic plane are then determined in a least square 
manner. 

In another embodiment, the parameters of a 
15 deformation function are determined, as depicted in step 

110, in which the coefficients of a polynomial or other 
function are determined to provide a morphing function 
that will directly calculate the new positions of the 
various points of the surface of the standard face model 
2 0 to the target face model and minimize a selected error 

function. 

In this embodiment, a least squares optimization 
process is used to determine the parameters of a 
predetermined deformation function that will minimize the 
25 square of the difference between the target points 

(x n ,y n , z n ) and the parametric functions having parameters 
o and £ n . In this instance, o is a vector of coefficients 
of a polynomial function selected as the deformation 




function, and ^ n is the coordinate position of the 
corresponding point in the standard face model, wherein: 



S = f j [{x" -X(a x ,X",Y\Z")f +{y n -Y(<r y ,X n ,Y" ,Z n )J +(z" -z(cf 2 ,X" ,Y" ,Z n 

n=l 

Eq. 4 



where X, Y, and Z are parametric equations for x, y, and 
z coordinates respectively. These equations have first 
and second derivatives with respect to the vertices 

10 positions of the target positions. 

Eq. 4 is solved according to known methods of 
solving least squares optimization problems. The 
resulting function X(a,£i n ), Y(o,£ 2 n ), Z(a,^ 3 n ) are 
typically non-linear polynomial functions. In 

15 particular, the functions X(a,§i n ), Y(c,£ 2 n ), and Z (o, £ 3 n ) 

are rational polynomial functions and advantageously can 
be Chebychev polynomials. Chebychev polynomials, as is 
known, provide a maximally steep transition for a given 
polynomial order. In another embodiment, an expansion of 

20 trigonometric or exponential functions could be used. 

Alternatively, the parametric equations X(c,£i n ), Y(a,£ 2 n ), 
and Z(a,^ 3 n ) can be NURBS, Non-Uniform Rational B-Splines. 

Once deformation functions has been determined, the 
target face basis, M 1 , can be determined by porting, or 

25 transforming, the standard face basis M to the target 

face, as depicted in step 112. In general the target 
face basis, M ' , is a function of the standard face basis 
M and the deformation function. In order to transform 




the basis vectors of the standard face model to the 
target face model, an eigensystem decomposition of the 
standard face model is first performed. An eigensystem 
decomposition of a matrix, A, consisting of vertex data 
5 can be performed using a singular value decomposition as 

described in the patent application entitled, Basis 
Functions of Three-Dimensional Models for Compression, 
Transformation, and Streaming filed June 15, 2001, 
attorneys' docket LIFX-002XX. An eigensystem 

10 decomposition performed by a singular value decomposition 

will transform an data matrix A into A=UWV T , where W 
contains the singular values of A and WV T form a basis M 
of the modes of the matrix A. In general all the singular 
values will contain the mean of the matrix A that is 

15 given by: 




Eq. 5 



where A T i is the row vector corresponding to a frame of 
2 0 the data stored in the matrix A. Alternatively, M 0 could 

be any other face Ai. As such, prior to the eigensystem 
decomposition, the mean of the matrix A, M 0 , is removed 
from each element of the matrix A. If A is an m by n 
matrix, with m>n there will be at most n singular values. 
25 The W matrix is a diagonal matrix containing the singular 

values in linear order in decreasing value. Accordingly, 
only the first r singular values will be large enough 
such that the basis vector Mi, formed from the 
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combination WV T , contains a significant information 
content. Thus, the basis M formed by WV T will contain 
useful information only in the first r by r rows and 
columns. Accordingly, by truncating the number of 
5 singular values used to those having a value greater than 

a predetermined threshold, the basis M of the matrix A 
can be reduced to an m by r matrix. Each column vector 
of M remaining after the truncation of the W matrix forms 
an eigenface of the corresponding data matrix, A. In 
10 particular, the i th eigenface can be formed from the i th 

column vector of M by adding the value of M 0 determined 
in Eq. 5. 

In one embodiment, the eigenfaces are computed by 
first computing Ai'=G(a,Ai), and the procedure described 

15 above for an eigenstructure decomposition of the matrix 

A ± ' . In general the function G(a,Ai) can be difficult to 
calculate efficiently given the size of the matrices used 
and the complexity of the function itself. Accordingly, 
it is advantageous to find other methods to calculate the 

20 eigenfaces or to represent animations. In one 

embodiment, the eigenfaces determined for the matrix A 
corresponding to the standard face model are transformed 
using the non-linear function G (a, X n , Y n , Z n ) = 
{ X (o x , X n ,Y n ,Z n ,) , Y (o y , X n ,Y n ,Z n ) , Z (a z , X n ,Y n ,Z n ) } determined above 

25 in Eq. 3A-3C or Eq. 4. In particular the i th eigenface of 

the standard face model is converted into the i th 
eigenface of the target face model according to: 

V[ - G{M 0 +V { ) Eq. 6 
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where V±' is the i th basis vector of the target face 
model. A basis matrix M ' is formed from the column 
vectors, M={Vi'}. To form the eigenfaces of the matrix, 
5 A, corresponding to the target face model the mean, M 0 ', 

of the matrix A corresponding to the target face is first 
computed as M'o=G(M 0 ). This value is added to each of the 
elements in the matrix M 1 . 

In another embodiment, if a standard face model 

10 exists having a set of facial characteristics that is 

similar to a target face model in terms of the age, 
gender, features, and ethnicity, the two faces may be 
similar enough so that the difference between the two 
shapes is a delta on the order of the difference between 

15 M' 0 and M 0 . The target image basis, M ' , can be 

approximated by adding M' 0 to each element in the matrix 
M. Due to the small size of the change in the basis 
matrix, the weighted row vectors Ui which correspond to 
the animation frames of the standard face model can be 

20 used with the new basis M ' to form expression or emotion 

sequences or sequences of visemes. 

If there is not a close correlation between the 
target face and the standard model, the function G(c,£ n ) 
must be solved for the new basis matrix M' . As discussed 

25 above, this may be a computationally inefficient 

calculation. In an alternative embodiment, a Taylor 
Series Expansion can be used to approximate the function 
as : 




G(£) = Gfe) + ^fi.<*r 

such that 



Eq. 7 



m 0 =g(m 0 ) 

M' i = d A Mi 
' d% 

5 

where X, Y, and Z are defined with regard to Eq. 3, and 
4i, ^2,and are the variables describing the x, y, and z 
axis of the particular sub-cube of the finite element 
mesh. In this case, the row vectors V'i form the 
10 eigenface matrix M' . The animation vectors Ui 

corresponding to the standard face model are provided, as 
depicted in step 114, and are used to port, or transform, 
the standard head animation vectors to the target head, 
as depicted in step 116by: 

15 

A i =U i *M' Eq. 8 

where A± is the image data corresponding to a frame of 
animation of the target face model, as depicted in step 
20 118. 

In another embodiment, the morphing function is 
determined using a linear combination of two or more 
weighted standard faces where one face is a "parent" 
25 standard face from which its emotions have been morphed 




to the others, i.e., an original standard face that 
includes a plurality of expressions. These expressions 
are linear combinations of the various poses of the many 
standard faces and the i th expression would be represented 
5 by a row vector including the various weights of the 

expressions. The other standard faces are a plurality of 
standard faces that have been created or acquired. . Each 
of the various faces can be weighted by an individual 
scale factor ai, 0L2, 013, . . . a n . In this embodiment, 

10 various linear combinations of the parent standard face 

and the plurality of expressions from other standard 
faces are used to create a new face that is as close as 
possible to the target face. A suitable norm may be used 
to define what "as close as possible" is. 

15 This procedure is typically ill-defined, and a 

better approach consists in applying an SVD procedure to 
derive from the plurality of standard faces a much 
smaller subset of linearly independent eigenfaces from 
which any parent face in the selected subset can be 

20 closely reproduced through linear combinations of the 

set. An expression can be ported, i.e., morphed, from 
any of the parent faces to the linear combination face. 
These "eigenemotions" can be combined in the same manner 
as the corresponding eigenfaces to form a new expression 

25 for the target face. 

In general, if there are k standard faces, the SVD 
decomposition will provide k+1 orthogonal basis matrices 
Fi, where i=l,2,3,. . . , k+1 . These orthogonal basis 
matrices are typically the same dimension as the data 




matrix' that was used to generate them, i.e., m by n where 
m>n. These orthogonal basis matrices may be reduced to a 
rank r, and hence to an m by r square matrix by removing 
the columns of the orthogonal basis that do not contain 
5 significant portions of information related to the 

images. Each of the orthogonal basis matrices is then 
scaled by the same scale factor of the corresponding 
image matrix determined above, such that the new basis 
matrix of the target face is given by: 

10 

M T =Y j a i *M i Eq. 9 

where M T is the orthogonal basis of the target face, the 
«i are the scale factor determined above, and Mi is the 

15 orthogonal basis matrix of the i th standard face. The 

expressions of one of the parent face is used and morphed 
to all of the other independent eigenfaces. To create 
displayable expressions for the target face, the 
expressions Ui of the parent face are combined with the 

20 new orthogonal basis matrix of the target face to form 

animation vectors Ui' as: 

U\ = U i *Y^a i *M i . Eq. 10 

25 In another embodiment, there may be first and second 

standard faces in which the first standard face is a 
parent standard face having a plurality of child standard 
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faces. A target face may be developed as a linear 
combination of the first standard face and the plurality 
of expressions described above. In this embodiment, it 
is desired to use an expression of the second standard 
5 face. The second standard face is then morphed into the 

target face using any of the morphing techniques 
described above. Because the target face is the linear 
combination of the first standard face and the plurality 
of child standard faces, it is the geometric equivalent 

10 of the second standard face. Since the two faces are the 

geometric equivalent the two have the same vertices, 
albeit at different coordinates. Accordingly, there is 
no need to use the standard markers as described above. 
Rather, the morphing is accomplished using the actual 

15 vertices data with whatever technique is used. If the 

orthogonal basis of the target face is given by M T , the 
target basis of the second standard face is given by M s , 
and the expression vector of the second standard face is 
given by U±, then the expression, Ui', for the target face 

20 is given by: 

U' t =U f » M s *{M T )~ l . Eq. 11 

In another embodiment, the target face may have an 
25 emotive expression displayed thereon. In this 

embodiment, morphing from a neutral expression standard 
face to an emotive target face can result in exaggerated 
expressions being displayed on the target face. For 
instance, if the target face included a smiling 
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expression, morphing from a neutral standard face would 
result in a smile. Adding a smile to the target face 
could result in an extremely un-natural exaggerated 
smile. Similarly, adding a sad expression could result 
5 in a neutral expression. To avoid this, prior to any 

other processing, the standard face is linearly combined 
with one or more weighted expressions associated 
therewith to create a similar or equivalent expressions. 
The various weights are then used throughout the 

10 subsequent processing as offset set points. 

It should be appreciated that the above process 
steps can be performed by directly by hardware, e.g., by 
a Filed Programmable Gate Array (FPGA) or the like. 
Similarly, the above process steps can be performed by 

15 software, stored in a memory, and executed by a 

microprocessor or other computing processor. Each step 
can be an individual subroutine, object, or other 
programming entity. In addition, a user can provide a 
photograph to be processed that is scanned etc., or can 

20 be provided on a computer readable medium or over a 

computer network such as the World Wide Web or the 
Internet. Similarly, the resulting animation vectors can 
be provided on a computer readable medium or over a 
computer network such as the World Wide Web or the 

25 Internet. 

Fig. 2 depicts an apparatus consistent with the 
above described methods. In particular, the apparatus 
200 includes an image capture module 202 that provides 
digital image data as described above with respect to 
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step 102. The digital image data can be provided by a 
customer or user to a service provider, i.e., an 
organization or individual who will process input images 
and provide as an output animated image data of the 
5 subject of the input image. Alternatively, the digital 

image data can be obtained by the service provider 
directly by taking 3D motion images of the subject. The 
digital image data is provided to the target image 
analysis module 204. The target image analysis module 

10 extracts the vertices and orientation data, as described 

with respect to step 104 above, and in addition, can 
provide marker locations as well. The extracted data is 
then provided to the transformation matrix module 206 
along with the standard image data from the standard 

15 image data storage module 208. The transformation 

matrix module 2 06 provides the morphing transformation 
between the target head and the standard head using one 
of the techniques described above with respect to step 
110. If the technigue selected requires that marker 

20 points be associated with particular vertices data, as 

described above with respect to step 108, that can be 
performed in this module as well. The morphing 

transformation is then provided to the animation vector 
module, 210 along with the orthogonal basis matrix of 

25 the target head from the target image analysis module 

and the orthogonal basis of the standard head from the 
standard head data storage module 208. The animation 
vectors can be provided to the user on a computer 
readable medium such as a magnetic disk, CD-ROM, or DVD 
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disk. Alternatively, the animation vectors can be 
provided across a computer network such as the World 
Wide Web, the Internet, or other data network. 

Those of ordinary skill in the art should further 
5 appreciate that variations to and modification of the 

above-described methods and apparatus for the above 
described image processing system may be made without 
departing from the inventive concepts disclosed herein. 
Accordingly, the invention should be viewed as limited 
10 solely by the scope and spirit of the appended claims. 




